Patent Application 

of 

Stephen E. Decker 
855 Mango Avenue 
Sunnyvale, CA 94087 
for 



Title of Invention: 

Remote control of a 
wireless electromechanical device 
using a web browser 



Federally Sponsored Research 

[0001] Not Applicable. This invention was not made under a government contract. The 
government owns no interest in this invention. 

Sequence Listing or Program 

[0002] Examples of the Server Code are included as Appendix Item 1 at the conclusion 
of this document. 

Background 
Field of Invention 

[0003] This invention relates to the remote control of electromechanical devices using 
control signals that are created on any deviceJiaving a web browser, transmitted via a 
communications network, received by computer, which in turn sends the control signals 
via wireless link to a remote controlled electromechanical device. 
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Prior Art 

[0004] Because this invention draws upon several different technologies, each will be 
discussed separately. At the conclusion of this section, the reader will be able to review 
the discussion of the few inventions that most closely resemble the one set forth here. 

Topic 1 - Radio Controlled Devices 

[0005] There is a significant body of prior art which describes the remote control of an 
electromechanical device using radio waves as the medium to transport control signals. 
Typically these involve a set of servos and or motors that operate a battery powered 
mechanical device such as a miniature car or toy plane. The behavior of the mechanical 
device is remotely controlled by a portable battery powered control unit. Both the 
mechanical device and the control panel are equipped with an antenna. Control signals 
are created by manually adjusting a variety of knobs, levers, and switches on the control 
panel. The control panel converts these behavioral requests into analog signals and sends 
them via radio waves to the mechanical device. The mechanical device converts the 
radio waves into electrical signals which in turn control the servos and or motors that 
produce a behavior in the device. 

[0006] Examples include: 



Patent No. Title US Class/Subclass 



4,168,468 


Radio Motor Control System 


340/825.63 


4,248,011 


Steering for RC Car 


446/456 


4,548,584 


Radio Controlled Mobile Device 


434/118 


5,481,257 


Remote Controlled Vehicle w/Camera 


340/825.69 


5,609,312 


Model Helicopter 


244/17.19 


5,762,533 


Toy Vehicle with adjustable wheels 


446/466 


5,816,352 


Remote Control Toy 


180/67 


5,816,888 


Remote Controlled Vehicle 


446/456 



[0007] All of these inventions, and the very many similar toys and devices available 
today, are highly limited in that: 

1 . in order to control the electromechanical device a person must have a physical 
control panel - meaning that control is not easily shared between a large number 
of people; 

2. anyone using the control panel to control the electromechanical device must 
themselves be within a relatively short range (usually line of sight) of the device; 
and 

3. the number of devices that an individual control panel can control is limited to the 
number of devices that can operate within the range of the transmitter. 

[0008] In short, this control design does not scale to very large numbers of 
electromechanical devices, controllers, or human participants, and is also severely limited 
by distance. 
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[0009] Another significant limitation is the complexity of control signals that can be 
generated using a physical control panel. The signals that ultimately drive the actions of 
the remote controlled device are entered into the control panel using a variety of levers 
and switches. If the person controlling the device wants to repeat a particular set of 
actions, that person must repeat the physical act of moving the levers and switches on the 
control panel. In this manner, the user cannot "record" a set of behaviors for playback. 
Similarly, because the control information is generated and sent in real time, the user 
cannot record a complex set of commands at a slow speed and then "play-back" the set of 
signals at a higher speed. 

[0010] In short, the control panel cannot remember what controls are being sent to the 
device, nor can it facilitate the entry of highly complex and numerous commands at a 
slower speed for playback at a higher speed. 

Topic 2 - Computer Controlled Children's Toys 

[001 1] Advances in industrial technology have created exciting opportunities for the 
development of new and interesting children's toys. 

[0012] One example of an electromechanical children's toy is the suite of products 
marketed under the trade name "Mindstorms ™" from the wonderful people at LEGO ®. 
Lego Mindstorms include robotic and electromechanical control components that enable 
people to build robots. The control information, or programming, for these robots is done 
on a personal computer and then uploaded to the robot. This technique provides the robot 
with a set of behaviors that can be triggered by elements in the robot's surrounding 
environment. For example, a robot can be built that senses light or motion and then takes 
an action, like making a noise or firing a toy gun. 

[0013] The heart of the LEGO system is the RCX microcontroller. The program for the 
chip is created on a personal computer using LEGO's proprietary programming code. 
This code is then sent from the computer using an infrared transmitter. An infrared 
receiver on the robot receives the program and stores it in the memory of the RCX 
microcontroller. 

[0014] The RCX is connected to a variety to sensors on the robot. Sensors capture 
information about the environment and send the data to the RCX chip where it is 
processed. Based on the program running on the chip, the RCX will send out signals that 
in turn control motors, pneumatics, and other elements that make the robot behave in the 
desired way. 

[0015] The Mindstorm products use an infrared beam of light to transmit information 
from the personal computer to the robot. Infrared communication has some significant 
limitations including: 

1 . very short range 

2. a direct line of sight is required between sender and receiver because, unlike radio 
waves, light will not pass through walls or around corners 
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[0016] The Mindstorm products are not intended to be remotely controlled. Once the 
code is downloaded to the robot, it behaves in a completely autonomous manner. If the 
user wants to change the behavior of the device, she or he must return to the computer, 
rewrite the code, reload the code onto the robot, and then continue. 

[0017] In addition to the LEGO example described above, there are several prior art 
examples of patents that combine personal computers and interactive toys. Examples 
include: 



Patent No. Title US Class/Subclass 



4,548,584 


Computer controlled mobile device 


434/118 


4,846,693 


Video Based instructional entertainment system 
using an animated figure 


434/308 


5,636,994 


Interactive Computer Controlled doll 


434/308 


5,733,131 


Education/Entertainment device 


434/307 


5,746,602 


PC peripheral Internet Toy 


434/169 


5,752,880 


Wireless interactive doll 


463/1 


5,977,951 


System and method for substituting an animated 
character when a remote control character is 
unavailable 


345/156 


6,319,010 


PC peripheral interactive doll 


434/169 



[0018] U.S. Patent No. 4,548,584 provides for "Computer control of a mobile device" 
where the device uses a micro-controller which in turn controls the motors and associated 
behavior of the device. Unlike the Lego product, the "Computer controlled mobile 
device" described in patent no 4,548,584 remains tethered to the computer via a cable 
approximately of approximately "16 feet or 5 meters". 1 This constant communication 
link between computer and device is in some respects an improvement over LEGO, 
however, the device is limited in that: 

1. the range and mobility of the device is limited by the length of the cable; 

2. only one person can control the device at a time; 

3. the person controlling the device must be in the same room as the device; and 

4. programming the device to perform tasks is accomplished by writing software and 
commands that can be interpreted by the microcontroller; and 

5. the mobile device cannot be controlled from a web browser. 

[0019] U.S. Patent No. 4,846,693 describes a "video based instructional entertainment 
system" in which the eyes and mouth of an animated doll (such as a toy bear) move in 
response to audio signals. In this invention, a control box is connected to a conventional 
videocassette recorder. Electromechanical control signals are scripted to match actions 
and images in a movie or presentation. Both elements are encoded on video tape. When 
the tape is played in said cassette recorder, the control box interprets the control signals to 
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control an attached doll. In this manner the illusion is created that the doll is having an 
animated conversation with the video image. 

[0020] While this invention does suggest use of a keyboard that would provide local real- 
time control of the toy, this invention is limited in that: 

1 . a lack of wireless control limits the mobility of the doll 

2. the control signals reside on a video tape or CD and do not provide for remote 
control 

3. the solution does not provide for control of the device by a person in a different 
location 

4. the device is not being directly controlled by a person and, as a result, can only 
execute pre-programmed actions. 

[0021] U.S. Patent No. 5,636,994 describes an "interactive computer controlled doll" 
whereby a toy doll is connected to a computer. A computer program originates control 
signals that are in turn sent to a micro-controller which sends electromechanical control 
signals to various motors in a toy doll. "A program source such as a CD-ROM contains 
information which is processed by the computer" 2 In other words, the control signals are 
all predetermined and stored on media. The invention does suggest the use of a wireless 
communication link, however, all of the control signals originate from a locally hosted 
software program and not from a person. As a result, this invention has the following 
limitations: 

1. control cannot be shared between a large number of people; 

2. control cannot be easily shared between multiple computers; 

3. this solution does not easily scale to control very large numbers of dolls in 
multiple remote locations; and 

4. the doll cannot be controlled from a web browser. 

[0022] U.S. Patent No. 5,733,131 describes an "education and entertainment device with 
dynamic configuration and operation" in which information about current events 
(weather, financial news, entertainment information) is sent via a Gaskill paging system 
or similar one-way communication link) to receivers embedded in dolls and/or small 
toys. This invention does provide for control signals to originate in a remote location 
and be sent to large numbers of devices. For example, a large number of "weather bears" 
will individually report the weather of the region in which they are located. 3 In addition, 
this invention provides for individual devices to be remotely controlled in a limited 
fashion by human beings. More specifically, the invention suggests that a person could 
push buttons on a telephone requesting a particular behavior. The signal is then sent 
through the public switched telephone network and ultimately to the toy. The request 
could cause the device to enunciate a specific phrase (e.g. a parent reminds a child to do 
homework, brush teeth, go to bed) or demonstrate a physical behavior. 



2 Patent No 5,636,994 from the section entitled "Abstract" 

3 Patent No 5,733,13 1 from the section entitled "Detailed Description of the Preferred Embodiment" 
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[0023] While this is a clever invention, it has the following weaknesses: 

1 . unlike the internet, the Gaskill paging system is a one-way communications link; 

2. control of a single toy cannot be easily shared among a large number of people; 

3. the individual generating the control signals has a very limited set of choices; 

4. the control interface (phone) does not provide a visual representation of the 
actions of the toy; 

5. the person controlling the toy does not know when their request is executed; 

6. they cannot see the result of their request unless they can actually see the device 
being controlled; and 

7. the device cannot be controlled from a web browser. 

[0024] U.S. Patent No. 5,746,602 describes a "PC peripheral interactive doll" for 
teaching and educating a child using an interactive doll with a wireless link to a personal 
computer. In this invention, scripted data is stored on a computer. The doll captures 
feedback from the child and sends information back to the PC. The software running on 
the PC determines what actions should be taken and then transmits motion and action 
scripts that drive additional subsequent behavior of the toy. The patent does suggest that 
the toy could have "access to mass storage devices and remote databanks through digital 
and analog communication links"*. While this implies access to remote databases via the 
internet, the local computer that is connected to the toy is the entity controlling the toy. 
The patent describes an alternate embodiment in which the computer receives audio 
signals from a person on a telephone in a remote location, but it does not describe a 
graphical interface that could be used by a person or persons for controlling the toy from 
afar. As a result, this invention has the following limitations: 

1 . control cannot be shared between a large number of people; 

2. control cannot be easily shared between multiple computers; 

3 . it does not scale to provide control of large numbers of devices situated in 
multiple remote locations; 

4. the invention does not allow for the person controlling the device to have fine 
grain control over the physical behavior of the toy; and 

5. the doll cannot be controlled from a web browser. 

[0025] U.S. Patent No. 5,752,880 describes an "Interactive Doll" where two toys are 
controlled by a computer system via radio (wireless) links. In this invention multiple 
toys respond to a plurality of input techniques including voice command and the use of a 
graphical interface. While this system allows for the control of multiple devices using a 
graphical interface it does not provide for remote control via the computer networks nor 
does it include the sharing of control between people in multiple remote locations. 

[0026] U.S. Patent No. 5,977,951 provides a "System and method for substituting an 
animated character when a remote control physical character is unavailable". This 
computer based system provides for an on-screen animated replica of a remote control 
device as a back-up when the remote control device becomes unavailable, but does not 
directly relate to the remote control of a wireless device via the internet. 



4 Patent No 5,746,602 from the section entitled "Background of the invention" 
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[0027] U.S. Patent No. 6,310,010 describes a "PC peripheral interactive doll" where a 
toy doll is connected to a computer. A computer program originates control signals that 
are in turn sent to a micro-controller which sends electromechanical control signals to 
various motors in a toy doll. These motors, in turn, cause the toy doll to move. While 
"data and routines available from the Internet are made available to the interactive 
doll," 5 the control of the doll resides with the software. The device is not remotely 
controlled, but is controlled by the PC to which it is connected. Because the original 
control information is generated by a software program and not by a person in real time, 
this invention has the following limitations: 

1 . a person or individual cannot directly control the doll; 

2. control cannot be shared between a large number of people; 

3. control cannot be easily shared between multiple computers; 

4. the responses of the toy are pre determined; and 

5 . the doll cannot be controlled from a web browser. 



[0028] German Patent DE 3009-040 describes a device for adding the capability to 
transmit sound from a remote control to a controlled model vehicle. The sound is 
generated by means of a microphone or a tape recorder and transmitted to the controlled 
model vehicle by means of radio communications. The model vehicle is equipped with a 
speaker that emits the received sounds. 

Topic 3 - Robotics and Computer Controlled Puppetry 

[0029] Robotics is another area that blends electromechanical control and computers. 
The following US patents deal with systems that are used for computer driven control of 
electromechanical devices: 



Patent No. Title US Class/Subclass 



4,825,136 


Mimetic function simulator 


318/568.1 


5,493,185 


Method for animating a motorized puppet 


318/3 



[0030] U.S. Pat. No. 4,825,136 discloses an apparatus for controlling a doll based upon 
storage and reproduction of analog and digital recorded signals. An attached recording 
device records, stores, and then transmits the electromechanical control signals that 
control servos on a puppet. Control cords connect the doll to the recording and playback 
device. This invention has several shortfalls. Specifically the invention does not: 

1 . provide wireless control of the device; 

2. scale to large numbers of persons who want to share control of the puppet; 

3. scale to control very large numbers of puppets; 

4. scale to control puppets located in multiple locations; nor does it 

5. allow the doll to controlled using a web browser. 

[0031] Patent No. 5,493,185 describes a "method for animating motor driven puppets 
(and the like) and apparatus for implementing the method". This invention provides the 
capability for a puppeteer to control multiple devices by remote control, whether wireless 



5 Patent No 6,3 100 10 from the section entitled "Description of the Preferred Embodiment" 
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or by cable. The invention allows for the combination of both preprogrammed and 
spontaneous human generated control signals as well as for the recording and playback of 
complex tasks. While an improvement over the prior art, this invention has several 
shortfalls including: 

1 . because control signals originate with the computer connected to the puppet(s), 
the number of people who can control the puppet is limited to the number of 
people who can use the single computer. As a result, control of the puppet is not 
easily shared amongst a large number of people; 

2. the invention does not easily scale to control very large numbers of devices 
located in multiple locations; and 

3. the invention does not allow for the puppets to be controlled from a web browser. 



Topic 4 - Telepresence/Telerobitics 

[0032] There are several examples of prior art that enable the remote control of a device 
from a great distance. The following prior art examples describe various means by which 
an electromechanical device can be controlled from a remote location. 

[0033] The "Robotic Arm Project" at the University of Australia maintains a robotic arm 
that can be remotely controlled over the internet from their web site at 
http://telerobotmech.uwa.edu.au/ . The arm is monitored by a webcam 6 which enables the 
person controlling the arm to see what actions are being taken. Visitors to the 
university's web site can control the robotic arm and move colored blocks around. 
Overall, this has been a successful experiment with approximately 500,000 people having 
accessed the robotic arm between 1994 and 2000. 

[0034] In order to control the arm, a user must download a java applet from the 
university. Control information for the arm is entered as text in the form of 3 dimensional 
special coordinates using an X, Y, Z notation with modifiers T and S controlling the 
acute angle of the robotic arm and the acute angle of the claw respectively. 

[0035] Software at the University of Australia converts the commands entered via the 
Java Applet into electrical signals that in turn control the robotic arm. 

[0036] In spite of its usage over the years, there are many elements which could be 
improved including: 

1 . the software that controls the arm is designed to operate in a non-commercial, low 
security environment (meaning that persons cannot control the device from a 
computer with standard commercial security measures in place e.g. a firewall); 

2. the experiment uses a highly technical interface that requires the user to learn a 
great deal before the interface can be used; 



6 A webcam is a camera that is connected to the internet and that sends images, photographs, or video over 
the internet so that they can be viewed in a remote location. 
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3. the experiment uses a text based input technique and does not capitalize on the 
invention and wide use of the computer "mouse" to enable traditional "drag and 
drop" capabilities which are so common in interface design today; 

4. in its current design, the system requires a physical (data cable) connection to the 
machine receiving the control information from the internet; and 

5. perhaps most important, the system provides very poor user feedback regarding 
the current position of the arm - neither the arm nor the toy blocks are graphically 
represented in a format that makes it is easy for the user to decipher what is 
happening with the arm or the blocks. Data regarding the position of the arm can 
only be obtained by reviewing the text based command window and by viewing 
the time delayed image provided by the web cam. 

[0037] The control applet is designed to be used in a non-commercial, low security 
environment consistent with educational use within a university campus. The Java applet 
requires a direct socket connection on TCP/IP ports 4444 and 4445 between the java 
applet and the university server. This means that persons using computers protected by a 
"Firewall" cannot control the robotic arm because Firewalls are designed to prevent 
traffic from flowing through these standard ports. To do otherwise would present a 
security risk to the company or community protected by the Firewall. 

[0038] The user interface requires the user to decode the position of the arm based on 3 
dimensional special coordinates provided in an X, Y, Z notation (e.g. a description of the 
current position of the arm might be "Robot Position = X=350 Y+480 Z=50 degrees 
T=17 degrees gripper open" ). 

[0039] Because of the non-graphical text based method of entering control information, 
study and preparation is required for the user to understand how to determine the position 
of the arm and to enter information. The interface does not allow for the manipulation of 
a graphical or animated representation of the robotic arm. 

[0040] In addition, once the control information has been entered, the user does not 
immediately know what the physical outcome of the control request was. The user must 
wait and see the results in the video window. 

[0041] Lastly, and perhaps most importantly, in this and other similar examples, the 
device being controlled has no mobility - meaning it is physically tethered to a server. 
The result is that it cannot be easily moved within the space, or moved to another room 
without being disconnected. 

[0042] Another example of Telepresence Technologies is The Puma Paint Project. 
Started at Villanova University, the project is currently being moved to Rodger Williams 
University in Rhode Island. Puma Paint allows the user to download a Java applet that 
accepts commands and control information that is in turn used to control a robotic arm 
located at Rodger Williams University. The robotic arm used by Puma Paint, is used to 
dip a paint brush into paint and then depress the brush against a physical canvas thereby 
enabling the user to paint a picture in a remote location. As with the Australian project, a 
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web cam is pointed at the canvas thereby providing the user with a real time picture of 
the painting process. 

[0043] The interface for Puma Paint is superior to that of the Australian project in that it 
is more graphical, however, Puma Paint still uses a set of 3 dimensional special 
coordinates provided in an X, Y, Z notation to describe the location of the robotic arm 
holding the paint brush. Similar to the Australian project, there are a number of text 
based user feedback elements that provide the user with complex and not immediately 
understandable feedback about the painting process (e.g. labels on the interface include 
"%acked?", "packet Q" , "ack'd cmds" and similar phrases which are not immediately 
easy to understand). 

[0044] Similar to the Australian project, Puma Paint is physically tethered to the machine 
receiving the control information from the internet. This prohibits greater mobility on the 
part of the device being controlled. For example, in its current form, Puma Paint could 
not be easily moved to another room in the university, nor could it be easily moved 
outside without using numerous lengths of computer cables. 



Topic 4 - Adult Entertainment Devices 

[0045] There are a wide variety of massage and related devices designed to soothe and or 
stimulate areas of the body. Examples include: 



Patent No. 


Title 


US Class/Subclass 


3,991,751 


Portable Vibrator 


12//36 


5,470,303 


Massage Device 


601/84 


5,911,686 


Male Sexual Aid 


600/38 


6,110,102 


Vision of Love 


600/38 


6,142,929 


Sexual Stimulation Apparatus 


600/38 


6,280,403 


Massage Device 


601/70 


6,203,491 


Adult Sexual Apparatus 


600/38 


6,368,268 


Method and device for interactive virtual control of 
sexual aids using digital computer networks 


600/38 



[0046] The most relevant example is Patent No. 6,368,268 which describes a "method 
and device for remote control of a sexual aid via the internet. The invention describes 
computers with a radio transmitter for control of a wireless device, and a video camera so 
that the actions of the device can be viewed by a remote party controlling the device. The 
process described in the application requires the person who wishes to control the device 
to obtain and install a piece of software on a personal computer. While this invention 
provides for the remote control of a wireless device, the process has the following 
deficiencies: 

1 . the invention requires the user to obtain and install software - precluding the user 
from spontaneously controlling a device. 

2. the manufacturer or provider of the invention must develop multiple versions of 
software to accommodate multiple operating systems and control devices; 
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3. the invention does not provide for an animated representation of the device being 
controlled. The result is that it must rely upon the video signal sent by the remote 
camera forcing the user to control a device she or he may not be able to see. 

[0047] WebPower Inc. under the trade name "SafeSexPlus.com" markets and sells a 
device called "the SafeSexPlus adapter". The SafeSex Plus adapter has been mentioned 
on CNN, the Howard Stern Radio Show, Wired Magazine, and other publications. 

The device consists of a small beige plastic box... with 
suction cups on the back, two light sensors... and a port 
for your sex toy" 7 

[0048] To operate the SafeSexPlus adapter, the user loads software (included) onto his or 
her computer. When run, the software creates the image of a square on the screen that is 
half white and half gray. Using the suction cups, the user then affixes the plastic box 
over the section of the screen that displays the colored square. 

[0049] A second person in a remote location uses similar software that generates a 
duplicate image of a white and gray square on their screen. Using a mouse, the remote 
user changes the color of the square from white to gray. The corresponding shift in the 
color of the square is sent back to the first via the internet. 

[0050] The color changes are then reproduced on the display of the first computer. The 
changes in color are detected by the light sensors on the SafeSexPlus adapter (plastic 
box) hanging from the monitor via suction cups. 

[0051] The changes in color are interpreted by the SafeSexPlus adapter, and the 
corresponding electromechanical control signals travel down a wire to the adult toy. 

[0052] As a result, the intensity of the vibration in the toy is a controlled by a person in a 
remote location via the internet using a graphical interface. 

[0053] While this invention provides for remote control of an electromechanical device 
via the internet, it has the following significant limitations: 

1 . the invention does not provide for wireless control of the device; 

2. the suction cup is prone to "slide" on a computer screen's smooth surface thereby 
moving the light sensors out of position and preventing communication between 
the computer and the device; 

3. the invention does not allow for two way communication between the screen and 
the SafeSexPlus adapter. A mono-directional information flow prevents the 
computer from detecting the presence of the SafeSexPlus adapter, and prevents 
the SafeSexPlus adapter from sending any kind of acknowledgement or error 
message if an input is incomplete, corrupted, or misunderstood; 

4. the person controlling the device is required to download a small application or 
"applet" in order to control the device; 



7 "The Love Machines" article by Tricia Baldwin published by Salon.com 
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5. the device can not be controlled using a web browser; and 

6. most importantly, interface does not provide a visual representation of the device 
being controlled. 

[0054] Feelthe.net LLC markets a product called "Sexsations" under the trade name 
Digitallntamacy.com. The Sexsations product enables someone to control an 
electromechanical device over the internet using a graphical interface. 

[0055] The product provides a Java based graphical interface that is downloaded over the 
internet and is then used to control up to four electromechanical devices located in a 
remote location. The Java interface allows the person controlling the devices to specify 
the body location and the level of vibration to be applied. The control signals are 
captured by the Java applet and sent over the internet to someone in possession of the 
Sexsations hardware device. The hardware device is connected to a personal computer 
via a 9 pin serial port connection. 

[0056] While this invention provides for remote control of an electromechanical device 
via the internet, it has the following significant limitations: 

1 . the invention does not provide for wireless control of the device; 

2. the nature of the serial connection between the Sexsations hardware device and 
the computer requires the computer to be rebooted in order to recognize the 
device; 

7. the person controlling the device is required to download a small application or 
"applet" in order to control the device; 

8. the applet is very large (more than 5 Megabytes) and can take several minutes to 
download; 

, 3. . the device can not be controlled using a web browser; and 
4. perhaps most importantly, interface does not provide a visual representation of the 
device being controlled. 

[0057] Cyber-Vibe Inc. is currently developing a product that would allow for wireless 
control of a sexual device. However, like the Safe-Sex-Plus and Sexsations products 
noted above, their product requires the person controlling the device to obtain and install 
an application on their computer. A Cyber-Vibe device can not be controlled using only 
a web browser. Also, as with the Safe-Sex-Plus and Sexsations products, the control 
interface for the Cyber-Vibe product does not include a graphical representation of the 
toy being controlled. The result is that user feedback is dependent upon being able to see 
the device in a real-time video image. If the device leaves the camera's field of vision - 
the user's ability to control the device is impaired. 

[0058] VR Innovations markets a product called the "Virtual Sex Machine". The product 
includes CD-ROMs or DVDs that contain video images and control signals. The product 
also includes a sexual stimulation device that can be connected to a computer using a 
standard 9 pin serial cable. When the DVD or CD-ROM is played, the computer displays 
the video images and relays the control signals to the sexual stimulation device. In this 
manner the sexual stimulation device is able to "respond" to the video images displayed. 
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[0059] This invention is limted in that it does not allow for real-time control by a person 
in a remote location; nor does it provide for wireless remote control of the device; 

[0060] In summary, while prior art examples include a wide array of remote controlled 
devices, and a variety of techniques for controlling them, none allows the user to control 
the remote device using only a web browser. All of the prior art example require that 
prior to controlling a device the user obtain a physical control panel or piece of software 
- none allows anyone with a web browser to spontaneously take control of a wireless 
device. None include an animated representation of the device being controlled and, as a 
result, are highly dependant upon a video image to help them understand the result of 
their control requests. 

Objects and Advantages 

[0061] The purpose of the invention is to provide the most effective means of controlling 
electromechanical devices via a wireless link, where said devices are located in a single 
or multiple far away locations, and where said devices are controlled by a single person, 
or by several people each in a different location. 

[0062] In addition, control of the device(s) is accomplished through the manipulation of a 
graphical interface where said interface includes an animation that emulates the behavior 
of the electromechanical device such that the person(s) controlling the device(s) can 
immediately understand the results of their manipulation and the corresponding behavior 
of the electromechanical device(s) without the need for visual access via a transmitted 
video image. The animated representation of the device being controlled provides for 
immediate feedback, to the person controlling the remote device negating the need for a 
video image or other means of seeing the results of the control requests. 

[0063] In its preferred embodiment, the graphical control interface is highly intuitive and 
requires little or no instructions. By merely looking at the controls, the user should be 
able to intuit how to control the device in question. Graphical and animated switches, 
knobs, and buttons are used in conjunction with simple pictures and symbols. 

[0064] When combined with a graphical representation of the device being controlled, 
the system promotes rapid learning because the user can immediately understand the 
results of a command or control request. 

[0065] One element that makes the invention presented here far superior to the prior art is 
an intuitive interface that requires little training or explanation. 

[0066] Lastly, the graphical controls described above reside complete with a web 
browser. Said another way - any digital device that can run a web browser (phone, next 
generation car dash board, kiosk) can control the device. 

[0067] This last point eliminates the requirement for an applet to be downloaded and 
installed on the computer of the person seeking to control a device in a remote location. 
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[0068] Specifically, the invention has the following objects and advantages: 

1 . a system that allows a computer to assist in the control of an electromechanical 
device; 

2. a method of wireless communication such that the electromechanical device is not 
physically tethered to the computer; 

3 . a system which allows control of large numbers of devices in separate remote 
locations; 

4. a system which allows control of an electromechanical device to be shared by 
large numbers of persons in remote locations; 

5. a graphical interface which assists the user in controlling the electromechanical 
device(s); 

6. a graphical interface that operates within the requirements of a web browser - 
dramatically reducing the requirements of the device capturing the control; and 

7. immediate graphical feedback presented to a person or persons controlling a 
single device (or multiple devices) in a remote location in the form of an animated 
representation of the electromechanical device(s) being controlled that emulates 
the actions and behavior of the physical device. 

[0069] This combination of the above objects and advantages represents a significant 
advantage over the prior art. 

[0070] For example, a significant limitation in the prior art field of Radio Controlled 
devices is the complexity of control signals that can be generated using a physical control 
panel. For example, because prior art radio controlled devices are controlled using 
physical levers and switches, if the person controlling the device wants to repeat a 
particular set of actions, that person must repeat the physical act of moving the levers and 
switches on the control panel. 

[0071] Unlike prior art in the field of Radio Controlled devices, the invention described 
here has the following advantages: 

1 . persons controlling the device(s) do not need a physical control panel. The 
controls for this invention operate within a web browser - thus allowing anyone 
with a display device to assume control of the device; 

2. the design of the system allows for all control signals to be centralized and 
managed such that control of any number of devices can shift between a very 
large population of users; and 

3. the invention presented here is not limited by distance - devices and persons 
controlling them do not need to be in the same location. ' 

4. The invention presented here would enable the user to "record" a set of behaviors 
for playback. Furthermore, the user can record a complex set of commands at a 
slow speed and then "play-back" the set of signals at a higher speed. - This 
record/playback capability enables the user to create complex and intricate 
combinations of control signals and then play them back at speeds that would be 
impossible for a human being to create in real time. 
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[0072] In short, this invention is far superior to prior art in the area of Radio Controlled 
devices because it can scale to accommodate a very large number of electromechanical 
devices, controllers, or human participants, and is not limited by distance. 

[0073] The invention presented herein has several advantages over the prior art of 
Computer Controlled Children's toys including: 

1 . the system enables control of one or more devices to be easily shared between 
large numbers of people; 

2. the system enables one or more people to share control of a single device; 

3. the use of the internet or other public communications utility enables the device(s) 
and the person(s) controlling it to be separated by vast distances; 

4. an easy to use graphical interface that provides an intuitive way for the person 
controlling the device to understand what to do; 

5. a graphical representation of the device being controlled that provides instant 
visual and auditory feedback regarding the behavior of the physical device being 
controlled; and 

6. a graphical interface that is designed to run completely within the constraints of 
the user's web browser. This allows for a high degree of compatibility across 
devices (Windows, UNIX, Apple, PalmOS) and does not require the user to 
download a special application. 

[0074] As noted above, an object of the invention is to enable a single person to control a 
very large number of devices. This can be accomplished because the control information 
can be routed through a single point (for example a server on the internet) where the 
control information can be replicated and sent out to any number of devices. 

[0075] Similarly, an object of the invention is to enable large numbers of persons to share 
control of a single device or of multiple devices. Again, this is accomplished through the 
routing of control information through a single point. Where several persons wish to 
influence the behavior of a single device, software can be used to facilitate the sharing of 
control. This can be accomplished in any number of ways. Example of how control can 
be shared include: 

■ having control quickly move among the users in a "round robin" fashion or at 
random 

■ using each control request represent a "vote" for a particular behavior where the 
behavior is determined by the number of control requests "voting" for a particular 
behavior; 

■ implementing a bidding system whereby users bid for control causing control to 
shift between users based on their willingness to spend money, or some kind of 
points in a closed (fictional) currency. 

[0076] In addition, as noted previously, the invention presented herein enables a greater 
complexity of control signals to be created by users. 
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[0077] Perhaps the most significant advantage over the prior art in the field of Computer 
Controlled Children's Toys, is that the device is not merely following a pre-determined 
script that dictates the behavior of the device. Instead, the invention presented here 
receives direction from an individual person - a person who can use intuition and 
spontaneous insight to create a more rich and unique experience. 

[0078] While the person controlling the device has a selection of "pre-set behaviors" 
available to them, they have the ability to shift quickly between these predefined 
behaviors and manual mode. As a result, each session where the device is used is unique. 

[0079] In the prior art field of Robotics and Computer Controlled Puppetry, the 
inventions are highly limited in that they do not scale to large numbers of devices nor do 
they enable large numbers of people to control the devices. As previously stated, a major 
object and advantage of the invention presented here is the ability to have a very large 
number of people share control of a very large number of devices. 

[0080] In the field of Teleprence and Telerobotics, the prior art examples are physically 
connected to computers with data cables, which limits the mobility of the devices being 
controlled. In addition, the prior art provides very poor user feedback regarding the 
position and configuration of the device being controlled and are overly reliant upon 
applications or "applets" that must be downloaded in order for someone to control the 
decide. 

[0081] The invention presented here is superior to the prior art in the field of Teleprence 
and Telerobotics for the following reasons: 

1 . The invention uses a wireless link to send data to the device - providing for a 
more mobile and flexible device; 

2. The invention does not require the use of a video image of the device being 
controlled; 

3. The invention uses an interactive graphical interface that makes it easy for the 
user to quickly understand how to control the device. The graphical nature and 
simplicity of design are significant in promoting the ability of the invention to be 
used across many different cultures and languages; 

4. The interface includes a graphical representation of the device being controlled 
which provides immediate visual and auditory feedback to the user regarding the 
impact of her/his control request and the corresponding change in the behavior of 
the device. A graphical simulation of the device being controlled, which emulates 
the actual behavior of the physical device being controlled, provides for better 
user feedback and learning; and 

5. The invention presented here uses a graphical interface that is designed to run 
completely within the constraints of the user's web browser. This allows for a 
high degree of compatibility across devices (Windows, UNIX, Apple, PalmOS) 
and does not require the user to download a special application. 

[0082] The invention presented here is also superior to the prior art in the field of Adult 
Entertainment Devices. 
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[0083] While there are several examples in the prior art that describe remote control of an 
electromechanical device, the prior art is limited in that each of the examples, they 

1 . do not provide a wireless connection between the computer and the 
electromechanical device(s); and 

2. do not provide an animated graphical representation of the device being 
controlled. 

[0084] The invention presented here is superior to the prior art in the field of Adult 
Entertainment Devices for the following reasons: 

1 . The invention uses a wireless link to send data to the device - providing for a 
more mobile and flexible device; 

2. The invention does not require the use of a video image of the device being 
controlled; 

3. The invention uses an interactive graphical interface that makes it easy for the 
user to quickly understand how to control the device. The graphical nature and 
simplicity of design are significant in promoting the ability of the invention to be 
used across many different cultures and languages; 

4. The interface includes a graphical representation of the device being controlled 
which provides immediate visual and auditory feedback to the user regarding the 
impact of her/his control request and the corresponding change in the behavior of 
the device. A graphical simulation of the device being controlled, which emulates 
the actual behavior of the physical device being controlled, provides for better 
user feedback and learning and eliminates the requirement of a video image of the 
device being controller; and 

5. The invention presented here uses a graphical interface that is designed to run 
completely within the constraints of the user's web browser. This allows for a 
high degree of compatibility across devices (Windows, UNIX, Apple, PalmOS) 
and does not require the user to download a special application. 

[0085] The objects and advantages are not limited to those described above. Additional 
objects and advantages will become apparent from a consideration of the drawings and 
ensuing description. 

Summary 

[0086] The system provides for one or more individuals to control one or more 
electromechanical devices where both the individual(s) and device(s) are each located in 
multiple remote locations. The system is comprised of one or more electromechanical 
devices, one or more wireless transmitters, one or more wireless receivers, and two or 
more computers that communicate via the internet, public switched telephone network, or 
other telecommunications utility. 

[0087] The invention presented herein is superior to the prior art in that it: 

■ uses a wireless link instead of a data cable; 

■ provides the ability to control multiple devices in remote locations; 

■ provides the ability for large numbers people to share control of a single device; 
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■ uses a graphical interface to capture control requests and educate the user on the 
immediate result of action taken by the device; 

■ uses a graphical and intuitive representations of the controls for the device thereby 
minimizing the amount of text required to educate the user on its operations and 
promoting for portability across multiple languages. 

■ provides an animated graphical representation of the device(s) being controlled; 

■ requires that the person(s) controlling the device(s) need only a web browser and an 
internet connection - a special application is not required; and 

■ does not require a video image of the device being controlled. 



Drawings 

[0088] Figure 1 illustrates how control signals move from a first personal computer, 
through the internet, to a server, to a second personal computer where the information 
travels along a USB cable to a wireless transmitter and then finally on to a wireless 
receiver where the signals are passed on to a motor control circuit which controls an 
electromechanical device. It is important to note that the first "computer" can be a phone, 
Television, PDA, or any device capable of running a web browser. 

[0089] Figure 2 illustrates how control information input at the first computer can be sent 
via the internet to the server where the control information is replicated and sent to a 
plurality of second computers, where each second computer has a wireless transmitter 
which is sending a signal to a wireless electromechanical device. Note that in this 
illustration each of the multiple second computers is in a separate location from the first 
computer. 

[0090] Figure 3 depicts a single second computer receiving signals from a plurality of 
first computers. 

[0091] Figure 4 describes how computers can simultaneously assume the role of both 
first computer and second computer. In other words, this drawing illustrates how a 
computer can both send and receive signals to other computers which are also serving 
both roles. In this example, a computer provides a graphical interface which sends control 
signals and at the same time receives control signals and routes them to the attached 
transmitter and associated device. 

[0092] Figure 5 is the logical extension of Figure 4, where a multitude of computers take 
on the role of both first computer and second computer simultaneously sending and 
receiving signals to a large network of computers performing similar dual roles. 

[0093] Figure 6 is a block diagram showing the logical modules in the Transmitter. 

[0094] Figure 7 is a block diagram showing the logical modules in the Receiver. 
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Reference Numerals used in Figures 



10 


First Personal Computer, PDA, phone, or any device capable of running a web browser 


20 


Internet Connection 


30 


Server 


40 


Internet Connection 


50 


Second Personal Computer 


60 


USB cable 


100 


Transmitter 


101 


Transmitter USB interface module 


102 


Transmitter data decoder module 


103 


Transmitter UHF Transmitter module 


200 


Receiver 


201 


Receiver UHF receiver module 


202 


Receiver data decoder module 


203 


Receiver data latch 


204 


Receiver motor controller 


300 


Electromechanical Device 



Detailed Description - Hardware 

[0095] The invention allows for someone using a web browser to control a wireless 
device in a remote location. The transmitter, receiver, and motor control modules 
together implement the wireless portion of this control path. 

Transmitter 

[0096] As shown in Fig 6, the transmitter is comprised of 3 modules: 101) USB Interface, 
102) Data Encoder, and 103) UHF Transmitter. 

[0097] Module 101 connects to the personal computer via an industry-standard Universal 
Serial Bus (USB) interface. In addition to receiving data, the transmitter module also 
draws power from the PC's USB interface. 

[0098] Data is sent from the USB interface 101 to a data encoding module 102 that 
encodes the parallel data received from the USB module into a serial data stream. 

[0099] The serial data stream from encoding module 102 is sent through a level 
converter, then to an RF transmitter 103. 

[0100] Supporting components of the transmitter module include voltage regulators and a 
serial EEPROM containing the USB vendor and product ID. 

[0101] In the preferred embodiment the transmitted RF signal is modulated by Amplitude 
Shift Keying (ASK) with a carrier frequency of 2. 1GHz and where the transmitting 
antenna is constructed as a PC board trace (eliminating the need for an external antenna). 
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[0102] Modules can be combined into discreet integrated circuits or, the functions can be 
carried out using dedicated chips. For example, the LINX TXE-433-KH, is a 
commercially available printed circuit board available from LINX Technologies 8 . The 
LINX chip combines both the transmitter 101 and encoder 102 modules in a single 
integrated circuit. In an alternate embodiment, these modules could be split among 
several chips. For example, Motorola produces several chips that provide RF 
transmission including the Holtek 6160 RF Transmitter. There are also chips that provide 
a dedicated encoding capability such the Motorola MCI 45026 encoder. Similarly, the 
encoder functionality could be provided using software residing on a simple 
microcontroller. 

Receiver / Controller 

[0103] As shown in Fig 7, the receiver/controller is comprised of 4 different modules 
including 201) UHF RF receiver, 202) data decoder, 203) Data Latch, and 204) motor 
speed controller. The receiver module can be powered internally by 4 AA batteries, or 
optionally by an external 6-volt DC power source. 

[0104] The UHF antenna 201 receives the RF signal from the transmitter 100 and 
recovers the serial data stream. This serial data is then routed to a data decoder 202. The 
decoder compares the address portion of the incoming data with the settings of the 
address setting on the back of the receiver. If the address matches, the data is sent on to 
the data latches 203. 

[0105] In the preferred embodiment, motor controller A is based on a timer chip that 
generates a pulse- width modulated (PWM) signal to regulate the speed of the external 
DC motors. The duty cycle of the PWM signal is determined by the discharge rate of the 
RC network. When the PWM signal is disabled, the external motor is turned off. 

[0106] In the preferred embodiment the receiver will respond only to data sent by a 
transmitter with a matching address value. This allows multiple pairs of transmitters and 
receivers to operate within the same reception area. 

Detailed Description - Software 

[0107] The software consists of several different components: 

1 . a graphical control interface 

2. a graphical animation of the device(s) being controlled 

3. "server side" control software 

4. USB device driver 

[0108] The graphical control interface resides on first computer 10 (shown in Figures 1, 
2, 3, 4, and 5). First Computer 10 might also be a "personal digital assistant" (PDA), 
kiosk, phone, and any other digital device capable of running a web browser. 



8 LINX Technologies, 575 S.E. Ashley Place, Grants Pass OR 97526. Phone # (541)471-6256 
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[0109] The purpose of the interface is to accept and transmit control information. The 
user manipulates the controls to create the desired effect in device 300 (as shown in 
Figures 1, 2, 3, 4, and 5). 

[0110] In its preferred embodiment, the graphical control interface is easy to understand 
meaning that with little or no instructions the user can immediately intuit how to control 
the device in question. Graphical and animated switches, knobs, and buttons are used in 
conjunction with simple pictures and symbols. In this manner, the user can look at the 
control panel and easily understand the result of pressing a switch, turning a knob, or 
pushing a button. One element that makes the invention presented here far superior to the 
prior art is an intuitive interface that requires little training or explanation. 

[01 1 1] In its preferred embodiment, the control panel is developed in Flash to optimize 
both the graphical richness of the user experience and to minimize the size of the file. In 
addition, a control panel written in Flash can write, manipulate, and send XML-encoded 
data to other applications. 

[0112] The control panel accepts the user inputs (the manipulation of the graphical 
controls) and transmits the control signals to computer 50 (shown in Figures 1, 2, 3, 4, 
and 5). 

[01 13] In its preferred embodiment, the control signals are folded into an XML data 
structure. By abstracting the electromechanical control information to XML, the 
invention will be able to communicate with many different devices. For example, this 
design will allow alternate embodiments of the invention to communicate with many 
different devices (servos, switches, relays, etc.) in the future with little or no change to 
the server software. 

[01 14] An important part of the invention is the provision of a graphical animation of the 
device(s) being controlled. The purpose of the animation is to provide immediate visual 
and auditory feedback to the user regarding the current behavior of the device(s). 

[0115] The provision of immediate visual and auditory feedback is superior to all of the 
inventions reviewed in the prior art. By combining the graphical control panel and 
animated graphical feedback, the user can easily understand what actions are available, 
input the desired behavior, and see the resulting behavior of the electromechanical device 
even if it is obscured from view. 

[0116] The final software element is the "server side" control software which resides on 
computer 50 and receives the information sent from computer 10. 

[0117] The server side software parses the XML encoded data structure and transforms 
the data into a format that can be sent to the USB transmitter device 60. 

[01 18] In an alternate embodiment, the server side software can forward the control 
information to another server where it can be recorded for billing or use analysis. 
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[0119] The final software element is the USB device driver. The USB driver enables 
computer 50 to communicate with Transmitter 100 via USB cable 60. 



Description of Operation 

[0120] In the preferred embodiment, the graphical control panel resides on Server 30 
(Pictured in Figures 1, 2, 3, 4, and 5). 

[0121] An end user views the control panel using a web browser via internet connection 
20 where it is displayed on computer 10. 

[0122] The control panel serves a number of functions. Specifically the control panel: 

1 . provides a graphical control interface and accepts the user requests; 

2. allows the user to input control requests by manipulating animated switches, 
knobs, buttons and the like; 

3 . captures the control requests; 

4. embeds the information in an XML object; 

5. transmits the XML object; 

6. contains an animated image of the device(s) being controlled; and 

7. displays the result of the control request by changing the behavior or the animated 
image such that the animated image mimics the behavior of the physical device 
being controlled. 

[0123] By manipulating the controls on the graphical panel, and by viewing the animated 
image, the user can easily understand how to create a specific behavior in the 
electromechanical device 300. 



[0124] The fact that the control panel contains an animated representation of the device 
being controlled eliminates the requirement for a video image of the device being 
controlled. 



[0125] The control panel forwards the XML object via internet connection 20 to server 
30 where it is routed via internet connection 40 to computer 50, as shown in Figures 1, 2, 
3, 4, and 5. 

[0126] In an alternate embodiment, Server 30 replicates the control signals and forwards 
them to multiple computers as shown in Figure 2. 

[0127] In an alternate embodiment, Server 30 manages the control requests from multiple 
users and forwards a subset of control information to computer 50 as shown in Figure 3. 

[0128] Computer 50 is running the server side software and is connected to Transmitter 
100 by USB cable 60. 

[0129] In alternative embodiments, the Transmitter 100 is physically housed within 
computer 50 and does not require USB cable and drivers. 
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[0130] Transmitter 100 sends the control signals via wireless link to Receiver 200. Any 
number of frequencies can be used depending upon the desired range between 
Transmitter 100 and Receiver 200. 

[0131] Receiver 200 uses the control signals to set the speed of the motors in 
electromechanical device 300. 

[0132] The nature of electromechanical device 300 is highly flexible and can be any 
mechanism with at least one motor. 

[0133] Examples of electromechanical devices which may be controlled by the invention 
presented here include vehicles, boats, aircraft, toys, robotic devices (including stand 
alone robotic arms or complete robots), dolls, puppets, automated manufacturing systems, 
automated assembly systems, home appliances, home automation systems, cameras, 
water and irrigations systems, and adult entertainment devices (such as a vibrator). 

[0134] In an alternate embodiment, Computer 10 contains both the control panel and 
server side software and an attached Transmitter 50 and associated electromechanical 
device 300. In this alternate embodiment an individual can use a single computer to 
control a device in a remote location while, at the same time, receive signals and have a 
local device controlled by someone in a remote location. This example is shown in 
Figure 4. 

[0135] In an alternate embodiment, Computer 10 contains both the control panel and 
server side software and an attached Transmitter 50 and associated electromechanical 
device 300. In this alternate embodiment, an individual can use a single computer to 
control a wireless electromechanical device in the same location. 

[0136] In an alternate embodiment, there are multiple instances of a computer serving a 
dual role both as 10 and 50. This single computer is then capable of controlling multiple 
devices in remote locations, while at the same time receiving control requests from 
remote locations that in turn control a device connected to the local computer. This is 
illustrated in Figure 5. 

[0137] In an alternate embodiment, the control information forwarded by server 30 is 
recorded for analysis or playback at a later date. 

[0138] The end result is that someone can, with little training or education, control one or 
more electromechanically device(s) located one or more remote locations. Similarly, an 
individual can posses an electromechanical device that is controlled by one or more 
persons located in remote locations. 
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